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Abstract 

The eigenvalue shift technique is the most well-known and fundamental tool 
for matrix computations. Applications include the search of eigeninformation, 
the acceleration of numerical algorithms, the study of Google's PageRank. The 
shift strategy arises from the concept investigated by Brauer 0] for changing 
the value of an eigenvalue of a matrix to the desired one, while keeping the 
remaining eigenvalues and the original eigenvectors unchanged. The idea of 
shifting distinct eigenvalues can easily be generalized by Brauer's idea. However, 
shifting an eigenvalue with multiple multiplicities is a challenge issue and worthy 
of our investigation. In this work, we propose a new way for updating an 
eigenvalue with multiple multiplicities and thoroughly analyze its corresponding 
Jordan canonical form after the update procedure. 

Keywords: eigenvalue shift technique, Jordan canonical form, rank-k updates. 



1. Introduction 

The eigenvalue shift technique is a will-established method of mathematics 
in science and engineering. It arises from the research of eigenvalue computa- 
tions. As we know, the power method is the most common and easiest algorithm 
to find the dominant eigenvalue for a given matrix A € C nx ™, but it is imprac- 
ticable to look for a specific eigenvalue of A. In order to compute one specific 
eigenvalue, we need to apply the power method to the inverse of the shifted 
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matrix (A — fil n ) with an appropriately chosen shift value fx € C Here, /„ is an 
n x n identity matrix. This is the well-known shifted inverse power method Q • 
Early applications of eigenvalue shift techniques arc focused on the stability 
analysis of dynamical systems the computation of the root of a linear or 
non-linear equation by using preconditioning approaches (l3| . Only recently, 
the study of eigenvalue shift approaches has been widely applied to the study 
of inverse eigenvalue problems for reconstructing a structured model from pre- 
scribed spectral data 0, @, 0, EH , the structure-preserving double algorithm for 
solving nonsymmetric algebraic matrix Riccati equation 0, Q , and the Google's 
PageRank problem [ill 113 ■ Note that the common goal of the applications of 
the shift techniques stated above is to replace some unwanted eigenvalues so 
that the stability or acceleration of the prescribed algorithms can be obtained. 
Hence, a natural idea, the main contribution of our work, is to propose a method 
for updating the eigenvalue of a given matrix and provide the precise Jordan 
structures of this updated matrix. 

For a matrix A G C" x ™ and a number fx, if (A, v) is an eigenpair of A, 
then matrices A + fil n and fiA have the same eigenvector v corresponding to 
the eigenvalue A + ii and /zA, respectively. However, these two processes are to 
translate or scale all eigenvalues of A. Our work here is to change a particular 
eigenvalue, which is enlightened through the following important result given 
by Brauer Q. 

Theorem 1.1. (Brauer). Let A be a matrix with Av = Xqv for some nonzero 
vector v. If r is a vector so that r T v = 1, then for any scalar Ai, the eigenvalues 
of the matrix 

A = A+(Xi- X )vr T , 

consist of those of A, except that one eigenvalue Xq of A is replaced by X\ . 
Moreover, the eigenvector v is unchanged, that is, Av = Xiv. 

To demonstrate our motivation, consider an n x n complex matrix A. Let 
A = VJV^ 1 be a Jordan matrix decomposition of A, where J is the Jordan 
normal form of A and V is a matrix consisting of generalized eigenvectors of A. 
Denote the matrix J as 

" Jfe(A) 
J 2 

where Jk{X) is a k x k Jordan block corresponding to eigenvalue A given by 

A 1 ••• 



J 



Jfc(A) 



A 







•. 

A 1 
A 



G C 



k x k 



and Ji is an (n — k) x (n — k) matrix composed of a finite direct sum of Jordan 
blocks. Then, partition matrices V and V -1 conformally as 

V=[Vi V 2 ], (V- 1 )* = [V 3 V 4 ], 
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with Vi,V 3 E C nxk and V 2 ,V 4 £ C" x ("- fe ). A natural idea of updating the 
eigenvalue appearing at the top left corner of the matrix J, but keeping V and 
V^ 1 unchanged, is to add a rank-fc matrix AA = V1AJ1V3 to the original 
matrix A so that 



A + AA = V 



■4(A) +AJ! 
J 2 



has the desired eigenvalue. Here, A J\ is a particular k x k matrix, which makes 
t/fc(A) + AJi a new Jordan matrix. Observe that the updated matrix A + A A 
preserves the structures of matrices V and V , but changes the unwanted 
eigenvalue via the new Jordan matrix J/t(A) + AJ\. In other words, if we know 
the Jordan matrix decomposition in prior, we can update the eigenvalue of 
A without no difficulty. Note that V 3 * and V\ are matrices composed of the 
generalized left and right eigenvectors, respectively, and V^V\ = Ik- In practice, 
given any generalized left and right eigenvectors corresponding to Jfc(A), the 
condition V£V\ = Ik is not true in general. Hence, the eigenvalue shift approach 
stated above cannot not be applied. 

In this paper, we want to investigate an eigenvalue shift technique for up- 
dating the eigenvalue of the matrix A, provided that partial generalized left and 
right eigenvectors are given. We show that after the shift technique the first half 
generalized eigenvectors arc kept the same. Indeed, the study of the invariant 
of the first half generalized eigenvectors is essential for finding the stabilizing 
solution of an algebraic Riccati Equation and is the so-called Schur method or 



invariant subspace method [14l . |8( . To advance our research we organize this 
paper as follows. In Section 2, several useful features of the generalized left and 
right eigenvectors are discussed. In particular, we investigate the principle of 
generalized biorthogonality of generalized eigenvectors. This principle is then 
applied to the study of the eigenvalue shift technique in Section 3 and 4. Finally, 
the conclusions and some open problems are given in Section 5. 



2. The Principle of Generalized Biorthogonality 

For a given n x n square matrix A, let cr(A) be the set of all eigenvalues 
of A. We say that two vectors u and v in C™ are orthogonal if u*v = 0. In 
our study, we are seeking the orthogonality of eigenvectors of a given matrix. 
The feature is know as the principle of biorthogonality and is discussed in fiol 
Theorem 1.4.7] as follows: 

Theorem 2.1. If A 6 C nx " and i/Ai,A 2 6 cr(A), with Ai ^ A 2 , then any left 
eigenvector of A corresponding to Ai is orthogonal to any right eigenvector of 
A corresponding to A 2 . 

Theorem 12 . 1 1 tells us the principle of biorthogonality with respect to any two 
distinct eigenvalues. Next, we want to enhance this feature to generalized left 
and right eigenvectors. 
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Theorem 2.2. [Generalized Biorthogonality Property] Let A G c™ x ™ an( ; [ e f 
Ai,A2 G cr(A). Suppose and {fi}f =1 are i/ie generalized left and right 

eigenvectors corresponding to the Jordan block J p (Xi) and J q {X 2 ), respectively. 
Then 

(a) I}X 1 ^X 2 , 

u*Vj = 0, 1 < i < p, 1 < j < q. 

(b) IfX 1 =X 2 , 

u * v j = Ui_ 1 v j+1 , 2<i<p,l<j<q-l, (la) 
u*Vj = 0, 2 < i + j < max{p, q}. (lb) 

Proof. Let U and V be two matrices defined by 

U = [ Ul ... Up ] G C" xp , V = [ «i ... v q ] G C" x? . 
By the definitions of 1 and we have 

U*A = JJ(Xi)U*, AV = VJ q {X 2 ). 

That is, 

CTAV = (U*V)J q (X 2 ) = J^{X X ){U*V). (2) 

Define components Xij = u*Vj, Xi t o = 0, and Xo,j = 0, for i = l,...,p and 
j = 1, . . . , q. Then implies that 

(Ai - X 2 )x id = Xi-ij - Xi,j-i, 1 < i < p, 1 < j < q. (3) 

It follows from §3§ and the assumptions of x%j that if Ai =/= X 2 , then Xi.j = for 
1 < i < p and 1 < j < q. This proves (a). 

By ([3]), we see that if Ai = A2, a^-ij = for 1 < i < p and 1 < j < q. 

It follows that Xi.j = 0, for 2 < i + j < max{p, q} and elements Xij coincide 
on the "matrix diagonals" i + j = s for any max{p, q} + l<s<p + q. This 
completes the proof of (b). □ 

Note that the values x<j defined in the proof of Theorem 12.21 imply that if 
Ai = A2, the matrix X = [xij] pxq is indeed a lower triangular Hankel matrix. 
Also, by (fla|) . we have the following useful results. 

Corollary 2.1. Let A G C nxn and let X G a {A). Suppose {ui} p i=1 and {v t } q l=1 
are the generalized left and right eigenvectors corresponding to the Jordan block 
J P (A) and J q (X), respectively. Then, if p and q are even, then 

<«i = 0, 1<*<|,1<J<|; (4) 

if p and q are odd, then 

u*Vj = 0, u* p+1 Vj = 0, ulvq+i = 0, 1 < i < ^-7—^, 1 <j < ^-77— ■ ( 5 ) 
22 2 2 
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Note that Corollary 12.11 provides only the necessary conditions for two gen- 
eralized left and right eigenvectors to be orthogonal. It is possible that two 
generalized eigenvectors arc orthogonal, even if they are not fitted in the con- 
straints given in @ and ([5]) . This phenomenon can be observed by the following 
two examples. We first provide all possible types of generalized eigenvectors of 
a Jordan matrix with one and two Jordan blocks, respectively. We then come 
up with two extreme cases for each Jordan matrix under discussion. One is with 
the smallest number of orthogonal generalized left and right eigenvectors. The 
other is with the largest number of orthogonal ones. 

Example 2.1. Let A = J2fc(A). Then all of the generalized left and right eigen- 
vectors {itj}?^ C C 2fc and {viYflli C C 2k , respectively, can be written as 

m = y]ai-j + ie2k-j+i, Vi = y^&i-j+iej, 1 < i < 2k, 
3=1 3=1 

where di and bi are arbitrary complex numbers and a\bi ^ 0. Moreover, if 
a, = bi = 1 for all i, then 

u*Vj = 0, 1 < i, j < k, 
u*vj ^ 0, k + 1 < i, j < 2k, 

and if a\ = b\ = 1 and a{ = bi = for all i > 1, then 

u*Vj = 0,i+ j^ 2k + 1, 
u*Vj ^ 0, i + j = 2k + 1. 

The second example demonstrates the orthogonal properties of the general- 
ized eigenvectors between two Jordan blocks. 

Example 2.2. Let A = Jfc(A) ® Jfc(A). Then all of the generalized left eigen- 
vectors of the first Jordan block Jfc(A) (the upper left corner) and the right gen- 
eralized eigenvectors of the second Jordan block Jfe(A) (the lower right corner) 
can be written as 

i i 

Ui = 2J ajek-j+i + b 3 e 2 k-]+i, fj = 2J c i-i+i e j + ^i-j+i e fe+ii 1 < i < k, 

3=1 3=1 

respectively, where a,i,bi,Ci and di are arbitrary complex numbers and (|ai| 2 + 
|&i| 2 )(|ci| 2 + \d\\ 2 ) > 0. Moreover, if di = bi = a = di — 1 for all i, then for all 
1 < i,j < k 

u*Vj = 0, i + j < k + 1, 
u i v j 7^ 0, i + j > fc + 1, 

and if ai — di = 1, bi = Cj = for all i, then 

u *i v j — 0> 1 < i, j < fc. 
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Given a matrix A E C nx ™, let us close this section with the study of the 
mapping of the resolvent operator (A — A/„) _1 on its generalized left and right 
eigenvectors. Evidently, the orthogonal property between two generalized left 
and right eigenvectors will be influenced after the mapping. This influence will 
play a crucial role in proposing an eigenvalue shift technique later on. 

Theorem 2.3. Let A be a matrix in C nxn and let Xq G cr(A). Suppose {itj}f =1 
and be the generalized left and right eigenvectors corresponding to J p (Xo). 

Let X be a complex number and X €" <j{A). Then 

(a) For 1 < i < p, 



(A-XI n )-\, t = j^JT^- 



- (Ac - xy~ j+l 



*fA \T W (-1)* j < 

Ui (A-XI n ) = L (Ao _ A)i - i+ i ' 
j=i 

(b) For i + j < p and i, j > 1, u*(A — XI n ) Vj = 0. 

Proof. Set A e C and A g a (A). Since (A - XI n )vi = (A - A)«i, (A 

A/,i) _1 ?Ji = jr. Also, (A — XI n )v2 = (Ao — A)«2 + «i. It follows that 

(Ao - A) 

( A xj r 1 , _ ^-(A-Ai n )-y _^ (-i) 2 -^, 



(Ao - A) ^ (A - A) 2 -^ 1 ■ 

Subsequently, a similar proof can be given without difficulty to different gener- 
alized left and right eigenvectors, that is, (a) follows. 

Apply Theorem 12.21 and part (a). It is true that u*(A — XI n )~ 1 Vj = 0, for 
i + j <P an d i,j > f. The result of (b) is established. □ 

Now we have enough tools to analyze the eigenvalue shift problems. We first 
establish a result for eigenvalues with even algebraic multiplicities and then 
generalize it to eigenvalues with odd algebraic multiplicities. We show how to 
shift a desired eigenvalue of a given matrix without changing the remaining 
ones. 



3. Eigenvalue of Even Algebraic Multiplicities 

In this section, we propose a shift technique to move an eigenvalue with even 
algebraic multiplicities to a desired one. We claim that based on our approach, 
we can keep parts of generalized eigenvectors unchanged. We also investigate 
all of the possible Jordan structures after the shift at the end of this section. 
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Theorem 3.1. Let A G C nxn , let Ao £ &(A) with algebraic multiplicity 2k and 
geometric multiplicity 1, and let {u.i}^ 1 and {vi}^ 1 be the left and right Jordan 
chains for Ao . Define two matrices 

U := [ui u 2 ■■■ life] , V := [vi v 2 ■■■ v k ] . (6) 

If matrices R* £ C fcxn and L £ c™x fc artj respectively, the right and left inverses 
of V and U* satisfying 

U*L = R*V = I k , (7) 

then the shifted matrix 

A:=A + (X 1 -X )R 1 R^ (8) 
where R\ := [V L\ and R 2 := \R U~\ , has the following properties: 

(a) The eigenvalues of A consist of those of A, except that the eigenvalue Xq 
of A is replaced by Ai . 

(b) Avi = Xivi, u\A = u*X\, Av l+ i = Xiv i+ i + v it u* +1 A = X x u* +1 + u*, for 
i = 1, . . . ,k — 1. That is, 

AV = VJ k (Xi), 
U*A = jJiXxp*. 

Proof. This proof can be obtained by considering the characteristic polynomial 
of A, that is, if A ^ c(A), then 

det(l-A7„) = det{A~ XI n )det(l n + {X!- X Q )RiR* 2 {A- XT,)- 1 ) (9) 
= det(A - XI n ) dct (I 2k + (Ai - X Q )R* 2 {A - XI^Ri) 
fX — X \ 2k 

= dct (A - XI n ) -f r ( by Theorem [2j and Theorem [U ) . 

\ Ao — A/ 

Since det(A — A/„) is a polynomial with a finite number of zeros, we may 
choose a small perturbation e > such that det(A — (A + e)I n ) ^ 0, that is, 
A — (A + e)I n is invertible. This implies that if A G cr{A), we can consider the 
characteristic polynomial det(A — (A + e)I n ) so that 



det(A - (A + e)I n ) = dct{A - (A + e)J„) 



A!-(A + e ) ^ 2 
A -(A + e) 



Observe that both sides of the above equation are continuous functions of e. By 
the so-called continuity argument method, letting e — > gives that 



det{A-XI n ) = dct(A-A/„) 
It follows that (a) holds. 



Ai - A x 2 



Ao-A 
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To prove (b), we see that by Theorem 12. 2[ 



Av\ = Av\ + [(Ai - Ao)PiP^]ui = ^o«i + (Ai - Ao)i>i = Ai«i. 
= Avi + — XoJRiRzlvi = \iVi + i + Vi, i = l,...,k — l. 

The same approaches can be carried out to obtain u\A = u*Ai and u* i+1 A = 
Aiu* +1 + itf, for i = 1, . . . , fc — 1. □ 

Next, it is natural to ask about the eigenstructure of this updated matrix A 
defined in Theorem 13.11 To this end, we use the notions given in Theorem 13. II 
Assume without loss of generality that A E t£ 2kx2k 7 and that P = \y± ... V2k] 
is a nonsingular matrix so that 



P- X AP 



-?2fc(Ao), 



By Thcorcm l2.21 wc know that the matrix product 

triangular Hankel matrix, where U\ = [uk+i 
for constructing matrices U and V in ©, that is, 



U* 

U2k 



p e c2/cx2fe j s a i ower 

. This suggests a way 



U 



and y = P 



where Q is some nonsingular and lower triangular Hankel matrix in C fexfe . 
the right and left inverses of ([7]) can be denoted by 



Also. 



R = P-* 



L = P 



S 2 

Q~* 



where S\ and S2 are arbitrary k x k matrices. It follows from ((5J) that 
A = A + (Ai - A )(yR* + it/*) 
= pfj 2fe (Ao) + (Ai-Ao) (R? 

= P 



(10) 





4 sr 




'0 5 2 Q*" 




( 





+ 


/fe 


)) 



J fc (A0 (Ai - A )(5i + S2Q*) 
J fc (Ai) 



That is, 



'Jfc(Ai) C 
Jfc(Ai) 



(11) 



for some matrix C E C kxk . Based on (fTTj) . the next two results discuss the pos- 
sible eigenspacc and eigenstructure types of the matrix T (i.e., A). To facilitate 
our discussion below, we use {ei}i<i<k to denote the standard basis in K from 
now on. 
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Lemma 3.1. Let C be a matrix in C kxk . If T is a matrix given by 



T 



Jfe(A) C 
J fe (A) 



(12) 



then T has the eigenspace 



E x = I 



span 



span 

{[o 



ei 







• 



span 





ei 
N k Ce 1 
ei 

I 



ifc k>1 =0, Ce 1 = 0. 
i/c M = 0, Cei^O. 
«/cfc,i ^ 0. 



corresponding to the eigenvalue X, where = Xlk — Jfc(A) and C = [cij]kxk- 

Proof. Given two vectors x\ and X2 in C fexl , let v T = [xj xj] be an eigen- 
vector of T with respect to A. It follows that 



or, equivalently, 



Tv = Xv, 



(J k (X) - Xh) Xl 
(J fe (A) - Xh)x 2 



-Cx 2 , 



0. 



The possible types of eigenspace can be obtained by directly solving ([T 



(13) 



Lemma I3H] suggests a possible characterization of all Jordan canonical forms 
of T. Note that if x is an eigenvector of the matrix T associated with a Jor- 
dan block J P (X), then its corresponding Jordan canonical basis 7, a cycle of 
generalized eigenvectors ofT, can be expressed as 7 = {v p , v p -\, . . . , vi}, where 

Vi = (T — XI 2 k) p ~ l (x) for i < p and v p = x. 

In this sense, we classify the possible eigenstructure types by using the notions 
defined in Lemma 13. II as follows: 

Case 1. Cfe,i = 0,Cei = 0. Then, T ~ J fc (A) © J fc (A) with two cycles of 
generalized eigenvectors taken as 



7i 



72 



ei 













' N k Ce 2 ' 


ei 




e-2 



i=2 



k-i+1 



Ce t 
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Case 2. Ck,i = 0, Ce\ ^ 0. Then T ~ J&(A)© Jfc(A) with two cycles of generalized 
eigenvectors taken as 



7i = 



72 = 




e-k 




i=l 



Case 3. c^i ^ 0. Then T ~ J 2fc (A) with the cycle of generalized eigenvectors 
taken as 



7 



f 


Cfc,iei 









j ... , 


" N k C ei ' 




ei 


) ' * * 3 



Cfc,ie/c 


k 
i=l 



k - i+1 Cei 



Here, we have identified all possible cigenstructure types of the matrix T . 
This observation leads directly to the following result. 



Theorem 3.2. Let A be the matrix defined by l|10p. Then, the Jordan canonical 
form of the matrix A is either Jfc(A) © Jfc(A) or J2fe(A). 

We shall now give an example to demonstrate the result of Theorem 13 . 1 1 and 
Theorem [ 



Example 3.1. Let A = J 4 (l) © J 2 (3) £ 



id U 



[e4 63] and V 



[ei e2\ be the first half of the generalized left and right eigenvectors of A cor- 
responding to the eigenvalue A = 1. We then want to change the eigenvalue 
A = 1 to A = 2 and observe the subsequent Jordan canonical forms. 

(a) From ([7]), if we take the right and left inverses R and L to be 

R = V = [ei e 2 ] , L = U = [e 4 e 3 ] , 
then the shifted matrix A satisfies 

A:=A + (2- l)RiI% = J 4 (2) © J 2 (3), 
where R x = [V L] and R 2 = [R U] . 

(b ) From ([?]). if we take the right and left inverses R and L to be 

R = [ei e 2 - e 3 ] , L = U = [e 4 e 3 ] , 
then the shifted matrix A satisfies 

A := A + (2 - l)i? x i^ = J 2 (2) © J a (2) © J a (3), 
w/iere i?i = [V £] and R 2 = [R U] . 



10 



Note that Theorem 13.21 also implies that the geometric multiplicity of A, 
defined in (|10[) . is at most two. On the other hand, an analogous approach can 
seemingly be used to derive a shift technique and characterize the correspond- 
ing eigenstructure for the eigenvalue with odd algebraic multiplicities. Indeed, 
this analysis for the odd case is much more complicated due to the orthogonal 
property caused by the middle eigenvector as it can be seen in Theorcm l2.2l and 
a different approach is needed for our discussion. 

4. Eigenvalue with Odd Algebraic Multiplicities 

Let us now consider the eigenvalue with odd algebraic multiplicities. If p = q 
and p, q are odd integers, observe two full rank matrices U = [iti . . . u p ] 
and V = [vi ... i>J . It follows from (fl~aj) that the diagonal elements of 
the lower triangular Hankel matrix U*V is constant. Thus, the inner product 
u* +1 Wp+i 7^ 0. With this in mind, the following result shows how to change an 

eigenvalue with odd algebraic multiplicities. 

Theorem 4.1. Let A G c™ xn ; an d \ Q fr e an eigenvalue of A having algebraic 
multiplicity 2k + 1 and geometric multiplicity 1, and let {ui}^^ 1 and {vi}^^ 1 
be the left and right Jordan chains for \$ . Define two matrices 

U := [u x u 2 ■■■ Ufc] , V := [vi v 2 ■•■ v k ] (14) 

and a vector r = — . If matrices R* G C fex ™ an d L £ i^nxk ar£ ^ reS p ec _ 

v t+i u k+i 

tively, the right and left inverses of V and U* satisfying 

R*V = U*L = I k , (15) 

then the shifted matrix 

A:=A + (X 1 -X )RiR* 2 (16) 
where Ri := [V Wfe+i IA and R 2 := \R r if] , has the following properties: 

(a) The eigenvalues of A consist of those of A, except that the eigenvalue Xq 
of A is replaced by Ai . 

(b) Avi = Xivi, u*A = u*Ai, Av i+ i = Xiv l+ i+Vi, u* +1 A = Xiu* +1 +u*, for 
i = 1, . . . , k — 1. That is to say, 

AV = VJ k (X 1 ) 
U*A = JJ(X 1 )U* 
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Proof. Since 



R* 2 (A- Xiy 1 R 1 



R*(A-XI)- 1 V R*(A-XI n )- 1 v k+1 R*{A-XI)- l L 
, 1 , r*(A — XI)^ 1 L 







A -A 




U*{A - XI)- 1 !, 



it follows from Theorem l2.2l and Theorem 12 .31 that the characteristic polynomial 
of A satisfies 



det (A - XI n ) 



det(A - XI n ) det (/„ + (Ai - X )RiR* 2 (A - XI,,)- 1 ) 
det(A - A7„)det (l 2k+1 + (Ax - X )R* 2 (A - XI^Rj 



det (A - XI n ) 



Ai — A 
An - A 



2k+l 



if A ^ p(A). For the case A G c(^4), a small perturbation of A is applied to 
make A — XI nonsingular. Thus, a similar proof like the one in Theorem 13. II is 
followed. This proves (a). 

We see by direct computation and Theorem 12.21 that 



Avi = Avi + [(Ai - X Q )R 1 R 2 ]vi = X a v 1 + (Ai - A )i>i = XiVi, 



Av. 



A fi+i + + (Ai - A )i?i 







X^ 



l,...,k-l. 



In an analogous way, we can obtain u\A = u\X\ and u* +1 A = Aiu* +1 + u*, for 
i = 1, , . , , k — 1, and (b) follows. □ 

Theorem 14.11 provides us a way to update the eigenvalue of a given Jor- 
dan block of odd size. Consequently, we are interested in analyzing possible 
eigenstructure types of the shifted matrix A. We start this discussion in an 
analogous way from Section [3] by using the notions defined in Theorem 14. II As- 
sume for simplicity that the given matrix A is of size (2fc + l)x(2fc + l) and 
P = \yi ... f2fc+i] is a nonsingular matrix such that 



P- 1 AP = J 2k+1 (X ). 



It follows that V = P 



Set U = P- 







for some lower triangular Hankel 



matrix Q G C kxk , and the vector vt+i = Pek+i, where ik+i is a unit vector in 
jg>2fc+i w j^ n a 1 in position fc+1 and O's elsewhere. Corresponding to formula (|15|) 
and the vector r given in Theorem 14. II wc define 



R = P- 



L = P 



S 2 
Q-* 



r = P-* 





w* /W[ 



where SI and S 2 are arbitrary matrices in C t - rci ~ i;XK , w = [w^Jfexi is a vector 
in C fe+1 , and w\ is the complex conjugate of w\. Then the shifted matrix (|16[) 
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satisfies 



A= A + (Ai - X )(VR* + v k+1 r* + LU*) 



P 



P 



■hk+i{Xo) + (Ai — A ) 





h 


Si 


( 









+ e fe+ i [0 w/wi] + 



S 2 Q* 
h 



(17) 
P- 1 



Jfc(Ai) (Ai-Ao)si {Xi-X )(S 



Ai 






h 

(Ai -A )(s 2 + 



ir 2 



[4 0]S 2 Q*) 



Jfe(Ax) 



where Si is the first column of Si and s 2 is the last row of S2. This implies that 
after the shift approach the matrix A is similar to an upper triangular matrix 



S:= 



J fe (A) a C 
A b T 
J fe (A) 



(18) 



for some matrix C £ C fcxfc and vectors a, b £ <C k . This above similarity property 
allows us to discuss the eigeninformation of the shifted matrix A. That is, 
the eigeninformation of A can be studied indirectly by considering the upper 
triangular matrix T of (|18l) 



Lemma 4.1. Let C be a matrix in 
S is given by 



id let a, b be two vectors in C k . If 



J fe (A) a C 
A b T 
J fc (A) 
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then S has the eigenspace 



span / 


ei 









i 




_0_ 




span / 


ei 









J 










N k Ce 1 

ei 



, ifh = 0,a fe ^O,c M =0. 



ei 



£a = < 



^61=0,0*^0,^,1^0. 

7V fc a 
1 


="0, ~a k = 0, c M / or 6x ^ 0, a fc = 0. 



span / 


ei 









1 









i/6i = 


0,a fe = 


span / 


ei 









1 










(19) 



1 

ei 



AT fe C ei 

ei 




span 



corresponding to the eigenvalue X, where = A/fc — Jfc(A), 61 = e^o, = el a, 
and C = [cijjkxk- 



Proof. Corresponding to the eigenvalue A, let v T — [xj xj xj] be an 
eigenvector of 5, where Xx,xs £ C k and X2 G C. It is true that the eigenvector 
v satisfies 



Sv = Aw, 



or, equivalcntly, 



(Jfe(A) - \I k )xi = -x 2 a - Cx 3 , 

0x 2 = -6 T x 3 , 
(J fc (A) - XI h )x 3 = 0. 

We then have the all possible types of eigenspace by discussing the cases given 
in (|T9)) step by step. □ 



Similarly, we proceed to discuss all possible Jordan canonical forms of this 
shifted matrix (|16[) through the discussion of this special block upper triangular 
matrix S given in f|18[). One point should be made clear first. Due to the 
effects of vectors a and b in S. It is too complicate to evaluate the generalized 
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eigenvectors in an analogous way as we did in Section [3J We, therefore, seek 
to determine the Jordan canonical forms by means of some kind of matrix 
transformation so that the structure and eigeninfomration of S are simplified 
and unchanged respectively. 

With this in mind, we start by choosing an invcrtible matrix 





~h 


V 


w~ 




Y = 





1 


z T 


g £<(2fc+l)x(2fc+l 










h_ 




is easy to check that 














~h 


-y —W + yz T 




Y~ 


1 _ 





1 
















h 





We then transform matrix S in (fT5|) by using Y and Y 1 such that 



YSY- 1 = 



Jfe(A) a-(J k (X)-XI)y 
X b T 





C 

z T (J k (X)-XI) 

MX) 



where 



C 



,j}kxk - WJ k (X) - J k (X)W + C + yb T - az T + (J k (X) - XI)yz^ 



^,3 



Specify the vectors a = [ai] kx i and b = [bi] kx i by their components, and let the 
matrix D = [dij] kxk = C + yb T - az T + (J k (X) - XI)yz T . 
Notice, first, that if we choose 



y T = [yi ai a 2 ... Ofc-i] and z T = [-b 2 -63 
then for any y\ and z k £ C we have 



-b k Zk] , 



a := a-(J k (X)-XI)y 
Next, observe that 



and b T := b T + z T (J k (X) - XI) = [h 0] . (20) 



(WJ k (X)-J k (X)W)ei = { 



-1102,1 

-w k .i 


W M _1 - W 2 ,i 

Wfc-l.i-l - tWfe,i 
WkA-1 



2<i<k, 
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where W 



[wijjkxk- We then want to eliminate the elements in C by choosing 

= di,i, 1 < i < k - 1, 

= w^-i + djj, 1 < i < fc - 1, 2 < j < k, 



so that 



1 '■./ 



0, 1 < i < k, 1 < j < k, 

y"]rffc_ij-i, i < i < 



(21a) 
(21b) 



From formulae ((20)) and ([2~T|) . it follows that by choosing appropriate vectors y, 
z and a matrix W, we can simplify the matrix S such that 



S~S:= 



Jfe(A) a C 
A b T 
J fc (A) 



where a = OkCk-, b = b\e\ are vectors in C k , and C = [c 



ij\kxk 



satisfies c\ 



0. 



for 1 < i < k — 1 and 1 < j < k. Note that C is a matrix with all entries equal 
to zero except the ones on the last row and is said to be in lower concentrated 
form [12]. This observation can be used to classify all possible eigenstructure 
types of S though the discussion of S. We list all the classifications as follows: 
Case 1. h ^ 0,a fe ^ 0. 

la. If c k ,i = . . . = c k ,i = and Ck,i+i ^ 0, for < i < k—1, then S — J2fc+i(A) 
with the cycle of generalized eigenvectors taken as 





b\a k e\ 




b\a k e k 







-f 





1 ' • • 1 





1 


h 























" 

















1 • • m 1 





7 


Tl 


, . . . , 


Tk-i 


j 


ei 




_ e. 




. h _ 




fk — i 





where 



e i+ i e C 



Ok 



■-i+3 



1 



hi 



6 C fc , 2<j<k~i, 



i < i < fc - «• 



lb. If = . . . = Cfc.fc = 0, then S ~ </2fc+i(A) with the cycle of generalized 
eigenvectors taken as 



16 



bia k ei 





Case 2. b x = 0,a k 0. 



ha k e k 













h 












ei 






etc 



2a. If c fc ,i = . . . = c fejfe _i = and c fe ,fe ^ 0, then 5 ~ .4+1 (A) © Jfc(A) with 
the cycles of generalized eigenvectors taken as 



7i 



72 



a k ei 




a k e k 










j . . . , 







1 

























" 












-£fc,fc 




j ... 3 






aft 


ei 




_ e fe _i 




e/c 



2b. If c k l = ... = c ki = and c k .i+i ^ 0, for < i < k — 1, then 5 
>^2fc-i(A) © J i+ i(A) with the cycles of generalized eigenvectors taken as 



7i 



72 



TTil 




m 2k 


—i 


m 


J • * * J 


ri2 k 


—i 







" 







5 * ' • ) 





i 


ei 




ei 







-Cfc,i+1 

ei+i 



where 



Ck,i+iej, 1 < i < fc, 

Ofcxi, k + 1 <j <2k-i. 

0(fe+l)xl) 

j'-fe+i-l 
E a,e T _ fc+l _ s 

fe-i-2 

E a s eT_ fc+ ._ s 

s=0 



-1 



fe-i-2 



k-i-2 



E «sCfe,fc- s E a s e 



«0 



1, ay 



1 i_1 



1 < j < k -i + 1, 

fc-i + 1 < j < 2fc - 2i- 1, 

2fc - 2i - 1 < j < 2k - i - 1, 

j =2k-i, 



a s c kyl+2 + s e C, 1 < j < fc - i - 1. 



s=0 



Here, if k = i + 2, we should ignore the second case define in rij by using 
the third one directly. 
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2c. If Ck,i = ... = Ck,k = 0, then S ~ J k+ i(X) © Jfc(A) with the cycles of 
generalized eigenvectors taken as 



7i = 



a k ei 




a k e k 










, . . . , 









1 
































j ... j 





1 




ei 




e k 







72 



Case 3.&i ^ 0, a k = 0. 

3a. If Ck,\ = . . . = Cfc.i = and Ck,i+i ^ 0, for < i < k — 1, then S 
J2k~i{X) © with the cycles of generalized eigenvectors taken as 



7i = 



72 



mi 




m 2 k-i 


]} 


Til 


i * * * ) 


n 2 k-i 

















&i 







J * * • J 










ei 







where 



Cfe,i+iej, 1 < j < fc, 

0fc X i, fc + l<. ? <2fc-i. 

0(fe+l)xl 5 

[ h o ] T , 

j-fc+'i-l 

biaj-k+i E a s ej_ fc+i _ s 

s=0 

fc-i-1 

V a s ej-k+i- s 



1, a, 



1 

a sCfc, l+ 2+s £ C, 



1 < j < k - i, 

j = k-i, 

T 

, k - i + 1 < j < 2k - 2i, 
2k - 2i < j < 2k - i, 

1 < j < k-i - 1. 



s=0 



Here, if k = i + 1, we should ignore the first case and replace the third 
case define in rij by using the forth one directly. 

3b. If c fc i = . . . = c k _ k = 0, then S ~ J k +i(X) © J k (A) with the cycles of 
generalized eigenvectors taken as 








7i = | 


h 









ei 


72 = | 














ei 






<7v 



<7v 
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Case 4. b\ = 0, au = 0. 



4a. If Cfc,i 7^ 0, then 5 ~ J2fc(A) © Ji(A) with the cycles of generalized eigen- 
vectors taken as 



where 





Cfc,l e l 






7i = | 





j ... , 
















72 






i/'iei 


1 




j-l 








- — X> V'sCfcj-s+i S C, for j = 2, . . . , i 



Cfel 



4b. If Cfe.i = . . . = Cfe.i = and Ck,i+i 0, for 1 < i < k — 1, then S* ~ 
>/2fc-i(A) © Ji(A) © Ji(A), with the cycles of generalized eigenvectors taken 
as 



where 



??? , 



7i 



72 



73 



'"l 


»i 




Pi 



1 





■>•••■> 


m 2 k-i 



1 














c k ,i+iej, l<j<k, 

Ofexi, + 1 < i < 2fe - i. 

0(fc+i)xi, 1 <j < + 1, 

j-fc+i-1 

a s ej- k+i - s , k - i + 1 < j < 2k - 2i, 

s=0 
fc-i-l 

a> s ej-k+i-s, 2fc - 2i < j < 2k - i, 

s=0 



1, ctj = - — — "V] a s c k , i+2+ s G C, for j = 1, . . . , k - i - 1. 



i-i 
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Here, if k = i + 1, wc should ignore the second case define in rij by using 
the third one directly. 

4c. If c k ,i = ... = c k . k = 0, then A - J fc (A) © J fe (A) © Ji(A), with the cycles 
of generalized eigenvectors taken as 



7i 



72 = 



73 














J . . . J 





ei 




_ e fe 


ei 









5 ' * * 3 













" 






1 


} 












Theorem 4.2. Let A be the matrix defined by (|17[) . Then, the Jordan canonical 
form of the matrix A is one of the types: J2fc+i(A), J2fc-i+i(A) © </i(A), and 
Jafc-»(A) © Ji(A) © Ji(A), forl<i<k. 

Now, we have all possible eigenstructure types of the matrix S". In view 
of such classifications above, it turns out that the geometric multiplicity of A. 
defined in (|T6| . is at most three. 



5. Conclusions and Open Problems 

The methods developed in this paper are used to shift an eigenvalue with 
algebraic multiplicities greater than 1, in the sense that the first half of corre- 
sponding generalized eigenvectors are kept unchanged. From the point of view 
of applications, the approach has the advantage that one can apply this shift 
technique to speed up or stabilizing a given numerical algorithm. 

It is true that there are many different kinds of eigenvalue shift problems 
for a wide range of applications in science and engineering. For example, in our 
recent work [15j . we apply the shift approach to remove two zero eigenvalues 
embedded in a nonsymmetric algebraic Riccati equation. After the shift, the 
speed of convergence of the simple iteration algorithm for finding the minimal 
nonnegative solution is significantly improved. Indeed, this application is a 
special case corresponding to Theorem 13.11 with k = 1. 

That is, in this work, we propose a more general way to shift eigenvalues of 
a given matrix with multiple algebraic multiplicities. But, it is worthy of note 
that the computation of the Jordan form is extremely sensitive to perturbations. 
It appears to be an interesting open and challenge problem to propose a reliably 
numerical method to compute the Jordan form of a given matrix with floating- 
point arithmetic. On the other hand, in most cases we are required to shift 
partial (not all) eigenvalues of a given Jordan block, change multiple eigenvalues 
simultaneously, or replace complex conjugate eigenvalues of a real matrix. All 
these questions are under investigation and will be reported elsewhere. 
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